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Abstract — In this paper, the sum capacity of the Gaussian Mul- 
tiple Input Multiple Output (MIMO) Cognitive Radio Channel 
(MCC) is expressed as a convex problem with finite number of 
linear constraints, allowing for polynomial time interior point 
techniques to find the solution. In addition, a specialized class 
of sum power iterative waterfilling algorithms is determined 
that exploits the inherent structure of the sum capacity prob- 
lem. These algorithms not only determine the maximizing sum 
capacity value, but also the transmit policies that achieve this 
optimum. The paper concludes by providing numerical results 
which demonstrate that the algorithm takes very few iterations 
to converge to the optimum. 

I. Introduction 

In recent years, the study of cognitive radios from an 
information theoretic perspective has gained prominence 
H). As the Federal Communications Commission (FCC) 
determines the ways and bands in which cognitive radios can 
be used, it is imperative that we understand the fundamental 
limits of these radios to benchmark gains from their design 
and deployment. Cognitive radio channels refer to those 
media of communication in which cognitive radios operate, 
thereby efficiently utilizing available resources. Moreover, 
since most wireless systems these days use multiple antennas 
at the transmitter and receiver, it is important that we study 
the limits in a Multiple Input Multiple Output (MIMO) 
setting. The situation considered in this paper is different 
from the traditional class of MIMO problems on account of 
the intelligent and adaptive capabilities of the cognitive radios. 

Based on the model proposed in Q, the cognitive 
radio channel is an interference channel {3) J4) J5) |(6] with 
degraded message sets in which the transmitter with a 
single message is called the "primary" or "licensed" user 
while the transmitter with both message sets is called the 
"secondary" or "cognitive" user. In this paper, we study the 
sum capacity of cognitive radios in a MIMO setting where 
both the primary and secondary transmitter and receivers 
have multiple antennas and the noise is Gaussian. The sum 
capacity enables the design of a MIMO cognitive radio 
system by specifying the sum rate required for the primary 
and the secondary users. Recently, an achievable region was 
found and shown to be optimal for the sum rate of the primary 
and secondary users Q under certain conditions on channel 
parameters. Though an achievable coding strategy based on 
Costa's dirty paper coding J8) was shown to be optimal, 



an optimization over transmit covariances is required. The 
optimization to determine the sum capacity is in general a 
nonconvex problem and is hence computationally difficult 

no. 

In this paper, we find that the nonconvex problem 
formulation is similar to a MIMO Broadcast Channel 
(BC) sum capacity problem formulation ifTOl . We therefore 
transform the nonconvex problem into a convex problem by 
using "duality"' techniques as detailed in iflOl . As a result 
we obtain a convex-concave game which can be solved in 
polynomial time. We propose efficient algorithms to find the 
saddle point of the problem and hence compute the sum 
capacity and optimal transmit policies. 

The convex-concave game formulation of the sum capacity 
of the MIMO Cognitive Channel (MCC) is a minimax 
problem in which the inner maximization corresponds to 
computing the sum capacity of a MIMO Multiple Access 
Channel (MAC) subject to a sum power constraint. There are 
many efficient algorithms in literature that solve saddle point 
problems and they are analogous to convex optimization 
techniques like interior point and bundle methods ifTTI . 
However these algorithms are both much more involved than 
our algorithm and offer limited intuition about the structure of 
the optimal value. Our algorithm is based on the sum power 
iterative waterfilling algorithm for BC channels lTT2l . but is 
significantly different as the waterlevel is no longer given, 
but has to be discovered through adaptation. We thus call 
this strategy, the adaptive sum power waterfilling algorithm, 
to achieve our objective of solving the minimax problem. 

The rest of the paper is organized as follows. In Section ITT1 
the system model is described and in Section [HI] we state the 
sum capacity problem for MCC. In Section IIVI the convex 
problem formulation is described. In Section [V] we propose 
the algorithm and numerical results are given in Section [VI] 
We conclude the paper in Section IVIII 

II. System Model 

We use boldface letters to denote vectors and matrices. |H| 
denotes the determinant of the matrix H and Tr(H) denotes 
the trace. For any general matrix S, denotes the conjugate 
transpose. I„ is the n x n identity matrix and H >^ denotes 



that the square matrix H is positive semidefinite. If E is a 
set, then C1(E) and Co(E) refer to the closure and convex 
hull of E respectively. 

We consider the MCC illustrated in Fig. 1. The primary 
transmitter and receiver have n pt and n pr antennas while the TZ ac h = < 
cognitive transmitter and receiver have n c t and n c ,r antennas 
respectively. 



the same. Let G = [H p p H CjP ]. The set lZ ac h is defined as 

((Rp, Rc), S p , S CiP , £ c ,c, Qj ■ 
Rp, R c > 0, S p , £ C , P , S c c y o 
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Rp < log( 
Rc < log(|I 
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Fig. 1. MIMO Cognitive Radio System Model 

Let X p (i) G c™p,* xl be the vector signal transmitted by 
the primary user and X c (i) G C" c fXl be the vector signal 
transmitted by the cognitive user in time slot i. Let H p p , 



Tr(Sp) < P p ,Tr(S C:P + S c , c ) < P c 

where S pne t is a (n p> t+n c ,t) x (n p ,t+n Ct t) covariance matrix 
while S c c is a n c ,t x n c.t covariance matrix. X p and E c ,p 
are principal submatrices of X Pi net of dimensions n Pi t X n p> t 
and n c ,t x n c ,t respectively. The set of all rate pairs lZi„ is 
given by 

Ki„ = C\(coSjR p ,R c ) : 3 £ p , £ c , p , £ c , c h and 

Q: \^(Rp, R c ), S p , S c , p , £ c ,c, Q^j G 1Z, 

It is shown in [7| that TZi n is an inner bound on the capacity 
region of the MCC. 



H 



P,c- 



H cp and H c 



be constant channel gain matrices as Let G a = [H pp an d K Q = [0 The set 



shown in Fig. 1. It is assumed that the licensed receiver knows 
H p p and H c p , the licensed transmitter knows H p p , the 
cognitive transmitter knows H pc , H cp and H c c and the 
cognitive receiver knows H pc and H c c . These assumptions 
are made so as to make the problem tractable and thereby 
provide a benchmark on performance of the system. Let 
Y p (i) G C"p-- Xl and Y c (i) G C" c - Xl be the signal received 
by the primary receiver and cognitive receiver respectively. 
The additive noise at the primary and secondary receivers are 
Gaussian, independent across time symbols and represented 
by Z p (i) G C"^ xl and Z c G 



rXl respectively, where 
iV(0,I„ Oir ). Z p (i) and 
Z c (i) can be arbitrarily correlated between themselves. The 
received signal is mathematically represented as 



Zp(i) ~ iV(0,I„ p ,J and Z c (») 



rt is defined as 



i?p>0,i? c >0,Q p ,S c . c ^O 

p .^ II+G^QpGt+^HcpSceHt p | . 

p s g[ ii+iH c . P s c , cH :. p i • 

i? c <log(|I+iH c . c S c . c Ht c |) 
Tr(Qp) + Tr(S c , c ) < P p + aP c 

and the set 7Z part out is defined as 



7? Q = < 

lx -part 



'^part.out 



CI Co {(Rp,R c ) : 3Q p ,S CjC h 



such that ((Rp,R c ), Q p , E c , c ) G TZ^ art 



Y p (i) = H PiP Xp(i) + H c , p X c (z) + Z p (i) 
Y c (i) = H p>c X p (i) + H c , c X c (z) + Z c (i). 

The covariance matrices of the primary and cognitive input 
signals are £ p (i) and S c (i). The primary and secondary 
transmitters are subject to average power constraints P p and 
P c respectively. Thus, 



^Tr(S p (i))<nP p 

i=l 
n 

^Tr(S c (i)) <nP c . 



III. Problem Statement 

In this section, we restate the sum capacity of the MCC as 
in 0. Before doing so, we develop the required notation for 



It is also shown in Q that TZ part out is an outer bound 
on the capacity region that includes the sum rate when 
certain conditions that depend on the channel parameters are 
satisfied. We compute the sum capacity of the MCC under 
those conditions. 

We now restate Theorem 3.3 from Q which paves the way 
for the MCC sum capacity problem formulation. For any /x > 
1, 



max riR v 

(R p ,R c )GK in 



R c = inf max 

a>0 (JJp,fle)e7Z.» 



fiRp + R c 



Therefore, the sum capacity of the MCC (denoted by 

Ca/cc(G q ,H CiC )) is expressed as 

CMCc{G a , H c , c ) = inf max R p + R c . (1) 

a>0 (R P ,R C )£K« , out 



IV. Formulation as a Convex Problem 

The inner maximization in the sum capacity of the MCC, 
stated above, corresponds to computing the sum capacity 
of a degraded broadcast channel in which the transmitters 
cooperate with a sum power constraint. This is illustrated in 
Fig. 2. We observe from the expression for the sum capacity 
in (HJ that the inner maximization problem is not a concave 
function of the covariance matrices Q p and E cc . Thus 
it is difficult to solve the entire problem using numerical 
techniques. However, as in lfl2l . we can use "duality" to 
transform the inner maximization problem into a sum capacity 
problem for the MAC with the same sum power constraint. 
This can be done because it is shown in [10] that sum 
capacity of the BC is exactly equal to the sum capacity of 
the dual MAC. These results enable us to convert the original 
problem to a convex-concave game. 



outputs a set of BC covariance matrices which achieve the 
same sum rate as the MAC covariance matrices. 

V. Adaptive Sum Power Iterative Water-filling 

We propose a class of algorithms to compute the sum 
capacity of the MCC. These algorithms are motivated by the 
sum power water-filling algorithms developed for computing 
the sum capacity and obtaining the optimal transmit policies 
for the MIMO BC. As in [12], we obtain a dual convex 
problem corresponding to a MAC. This dual MAC problem is 
a convex problem and thus can be solved using the multitude 
of convex solvers in polynomial time. Our intention, as that 
in ll9l lfT3l is to exploit the problem's structure to yield a more 
intuitive and easy-to-implement algorithm for this problem. 
Specifically, it is to derive an algorithm that reflects and 
converges to the KKT conditions corresponding to cognitive 
radio sum capacity. 
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Fig. 2. MIMO Broadcast Channel 



Let Q c = 



where the zero matrices have ap- 





. o s c , c 

propriate dimensions such that S c c has dimension n c t x n c _ t 
and Q c has dimension (n P:t + n c , t ) x (n P:t + n c ,t)- The sum 
capacity of the MCC can therefore be expressed as 

Cmcc = inf maxlog|I + G^SiG a + K^S 2 K Q 

a>0 Si ,S2 

subject to Si,S 2 h 0,Tr(Si) +Tr(S 2 ) < P p + aP c (2) 

where the maximization is performed over covariance matrices 

51 and S 2 , which are obtained using BC-to-MAC transforma- 
tions of Q p and Q c such that the sum of the traces of Si 
and S 2 satisfies the sum power constraint P p + aP c . This 
new problem is concave in the covariance matrices Si and 

5 2 and convex in the scalar a with linear power constraints 
and is thus a convex-concave game. The proof of the fact 
that the problem is convex in a is given in the appendix. 
This min-max problem can be solved by using interior point 
methods or other equivalent convex optimization methods for 
saddle point problems which have polynomial time complexity 
JTTJ. Once the optimal Si and S 2 are obtained, we can apply 
the MAC-to-BC transformation lHol to obtain the optimal 
transmit policies of our original problem. The MAC-to-BC 
transformation, takes a set of MAC covariance matrices and 



Individual power iterative waterfilling was found to 
achieve the capacity of a MAC channel with separate power 
constraints per user in |9). This was then extended to 
BCs by the sum power iterative waterfilling algorithm in 
ifPJl . which is based on the dual MAC's KKT conditions. 
While neither of these two algorithms works directly 
for the MIMO cognitive radio channel, we use analogous 
principles to derive an adaptive sum power iterative algorithm. 

Before proceeding further, we review the waterfilling algo- 
rithm for the single user point to point MIMO case. Consider 
the problem, 



1 



max -logll + H^Hl 

Tr(S)<P, S^O 2 



(3) 



Let the eigen values of the covariance matrix S of size n x n be 
Ai, A 2 , . . . , A„ and the singular values of the channel matrix 
H be oi, o"2j • • • j c„. Then the waterfilling solution is given 
by 

Aj + l/af = K, if 1/af < K (4) 
Ai = 0, if l/af > K, (5) 

where K is a constant such that ^\ A; = P. KKT conditions, 
along with complementary slackness yield conditions (4) and 
(5) 03) 03). We now recall the sum power iterative water- 
filling solution for the MIMO MAC as studied in fl3l . The 
problem is stated below: 



Tr(^ Si)<P, s^o 2 



ilogll + ^HjSiHi 



(6) 



The KKT conditions for this problem are similar to the 
point to point case except that in the MAC case, the 
channel H in (01 for User i is replaced by the effective 
channel matrix H.;. e // = H;(I + V . . US, 1 1 , ). In the 
sum power waterfilling algorithm, we waterfill for all the 
users simultaneously, while in individual power iterative 
waterfilling, user waterfilling is sequenced lfT2l . 



The problem considered in this paper has a min-max for- 
mulation as given in (f2j) unlike the pure max formulations 
for the MAC and BC capacity problems HUE!. The idea 
behind our algorithm is to start with a feasible choice for 
a. For a given a, the joint water-filling on the two users is 
the optimal strategy for the inner maximization problem. In 
d2J, we perform a joint water-fill exactly once for the inner 
maximization, use this solution to solve the outer minimization 
with respect to a and iterate between the two. Thus, we end 
up with one maximization problem (for a choice of a) given 
by 

S X) S 2 = argmaxlog|I + G^TiG Q + K* T 2 K a | 

Ti,T 2 

subject to Ti,T 2 ^0, Tr(Ti) + Tr(Ti) < P p + aP c 



a joint waterfill with power P p + cr™ 1 - ) P C . 
{S[ n \ S 2 ™ } } = argmaxlog|I + G^ (n _ 1) TiG a (n-i) 

Ti,T 2 

+ K^_ 1) T a K ttC »-i)| 

subject to Ti, T 2 >r and 

Tr(Ti) + Tr(Ti) <P P + a^ n -^P c . 

4) Use and S 2 from Step 3 to obtain by solving 
the following univariate optimization problem. 



v(«) - 



argminlog|I + GUs[ n) Gp + K^yS^K^I 

0>O 



where 7 



P P + (3P C 



P, 



(n-l)P, 



is a scalar. 



and a minimization problem (for a given choice of covari- 
ances) as: 



a = argminlog|I + gWSiGa + K^U^Kgl 

/3>o 



where 7 



P P + PP C 

Pp +«("-!) P c 



is a scalar 



and a*-" l > is the previous iterate of a. 



5) Return to Step 2 until parameters converge. 

As mentioned before, the above algorithm is a very intuitive 
extension to the sum power waterfilling algorithm for the 
MIMO BC channel. The intuition arises from the fact that 
at the saddle point, the KKT conditions must be satisfied for 
both the max and the min problems. Although we may not be 
able to always guarantee convergence of the algorithm to the 
optimal solution, when it does converge, the algorithm takes 
very few iterations to do so. 



The solution of one is fed to the other, and the process 
is repeated until convergence. This forms the core of the 
adaptive sum power iterative waterfilling algorithm. 

We refer to the procedure detailed above as Algorithm 
1. As the minimization with respect to a can be somewhat 
involved (even though a is a scalar), we construct another 
algorithm we call Algorithm 2. In Algorithm 2, we only 
obtain a descent at each iteration by a simple line search 
like Newton search. We do not solve the outer minimization 
problem completely at every iteration as in Algorithm 1, 
which further simplifies the overall algorithm. In Section |Vl] 
we illustrate through examples that this highly simplified 
algorithm, with one waterfill and one descent in each iteration 
has nearly as good a convergence rate as exact solutions 
at each step. In the following, n refers to the iteration number. 

Main Algorithm (Algorithm 1): 

1) Initialize a^ ' to any number greater than 0. 



VI. Numerical Results 

In this section we present numerical results to compare 
the behavior of Algorithms 1 and 2. In Fig. 3, we plot the 
sum rate versus the number of iterations for a MCC with two 
antennas at both the primary and cognitive receiver and one 
antenna each at the primary and cognitive transmitter with 
power constraints P p = P c = 5. The channel matrices are 



G ( 
and K c 



-0.4326 -1.6656 
0.1253 0.2877 

-1.1465 
1.1909 



when a = 1. We find that both Algorithm 1 and Algorithm 2 
converge to the same sum rate. However this may not always 
happen depending on the initial conditions chosen for the 
Newton search. We also observe that in some cases Algorithm 
1 converges in fewer iterations when compared to Algorithm 
2. 



2) Generate the effective channels as 



VII. Conclusion 



= G 



fl + K 



K, 



(I + G 



-i)S 2 



(n-l) 



K 



t 

a (n-l) 



3) Obtain covariance matrices and S 2 " ; by performing 



Si 



(n-l) ( 



;(») 



-1/2 



-1/2 



In this paper, we proposed a class of algorithms to compute 
the sum capacity and the optimal transmit policies of the MCC. 
This was made possible by transforming the MCC sum capac- 
ity problem as a convex problem using MAC-BC (otherwise 
called as uplink-downlink) duality. The algorithm performs a 
sum power waterfill at each iteration, while simultaneously 
adapting the waterlevel at each iteration. 
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Fig. 3. Convergence of Algorithm 1 and Algorithm 2 to the sum rate 



Appendix 

Proof of convexity of the objective in (0 in a: Let F(a) = 
log|I + G^SiG^ + Kj,S a K a |. Hence, 



F = log 



I + Ht p S!H 

Hi „SiH c 



Ht iP S!H c , p 
H+ SiH c .p+Ht c S 2 H c ,c 



= log|I + Hi iP SiH PiP | 

j HtpSiHc.p + Hj. C S 2 H C , c 



log 



H tp S iHp, P (I + Hp p SiHp.p) 1 Hl > p SiH Cj p 



1 + 4 



where c 



Thus F is of the form F = c + log 
log|I + H p pSiHp.pl and A = Hj. pSiHc.p + Ht c S 2 H c . c - 
Ht pSiHp, p (I + Hp,pS 1 H p , p )- 1 H p p SiH c ,p. From matrix 
theory lfl6l Chap. 7], we know that 1 + 4 is positive semidef- 
inite for all a > since I + G£,SiG a + Kj l S 2 K Q and 
I + Hp pSiHp p are positive semidefinite for all a > 0. Let 
Aj,z = 1, 2, 3, . . . , n c t be the eigenvalues of A. Therefore, 
for every i, 1 + ^ > for all a > which implies > —a 
for all a > 0. Hence Ai > for i = 1,2,3,..., n c t and A is 
positive semidefinite. IMr is given by 
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= Tr 



2A/ i+ An-i 

a 3 \ a 



Tr 



A\-l A 



An- 1 



Tr 



A( I + *)-V 2I+ *)( I + *)- 



Using matrix theory results |[T6l Chap. 7] we can further show 
that > for all a > 0. Thus F(a) is convex in a. 



